RESUMO
OBJECTIVE: The artificial intelligence competition in healthcare was organized for the first time at the annual aviation, space, and technology festival (TEKNOFEST), Istanbul/Türkiye, in September 2021. In this article, the data set preparation and competition processes were explained in detail; the anonymized and annotated data set is also provided via official website for further research. MATERIALS AND METHODS: Data set recorded over the period covering 2019 and 2020 were centrally screened from the e-Pulse and Teleradiology System of the Republic of Türkiye, Ministry of Health using various codes and filtering criteria. The data set was anonymized. The data set was prepared, pooled, curated, and annotated by 7 radiologists. The training data set was shared with the teams via a dedicated file transfer protocol server, which could be accessed using private usernames and passwords given to the teams under a nondisclosure agreement signed by the representative of each team. RESULTS: The competition consisted of 2 stages. In the first stage, teams were given 192 digital imaging and communications in medicine images that belong to 1 of 3 possible categories namely, hemorrhage, ischemic, or non-stroke. Teams were asked to classify each image as either stroke present or absent. In the second stage of the competition, qualifying 36 teams were given 97 digital imaging and communications in medicine images that contained hemorrhage, ischemia, or both lesions. Among the employed methods, Unet and DeepLabv3 were the most frequently observed ones. CONCLUSION: Artificial intelligence competitions in healthcare offer good opportunities to collect data reflecting various cases and problems. Especially, annotated data set by domain experts is more valuable.
RESUMO
Clinical decision support systems are data analysis software that supports health professionals' decision - making the process to reach their ultimate outcome, taking into account patient information. However, the need for decision support systems cannot be denied because of most activities in the field of health care within the decision-making process. Decision support systems used for diagnosis are designed based on disease due to the complexity of diseases, symptoms, and disease-symptoms relationships. In the design and implementation of clinical decision support systems, mathematical modeling, pattern recognition and statistical analysis techniques of large databases and data mining techniques such as classification are also widely used. Classification of data is difficult in case of the small and/or imbalanced data set and this problem directly affects the classification performance. Small and/or imbalance dataset has become a major problem in data mining because classification algorithms are developed based on the assumption that the data sets are balanced and large enough. Most of the algorithms ignore or misclassify examples of the minority class, focus on the majority class. Most health data are small and imbalanced by nature. Learning from imbalanced and small data sets is an important and unsettled problem. Within the scope of the study, the publicly accessible data set, hepatitis was oversampled by distance-based data generation methods. The oversampled data sets were classified by using four different machine learning algorithms. Considering the classification scores of four different machine learning algorithms (Artificial Neural Networks, Support Vector Machines, Naive Bayes and Decision Tree), optimal synthetic data generation rate is recommended.
